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PATENT 
Paper No. 
File: Greene-P1-03 
IN THE UNITED STATES PATENT AND TRADEMARK OFFICE 



Inventor REES, Frank L. 

Serial No. 10/722,648 

Filed November 25, 2003 

For Gauss-Rees Parametric Ultrawideband System 

Group Art Unit 3662 

Examiner : LOBO, IAN J 

MS: Appeal 



Honorable Commissioner of Patents 
P.O. Box 1450 
Alexandria, VA 2231301459 

AMENDED BRIEF ON APPEAL 
ON BEHALF OF APPELLANT 

SIR: 

This is an appeal from the Final Action of the Examiner dated 27 February 2007, 
rejecting claim 1 pending in this application. 

Please charge the fee under 37 C.F.R. §1.17, the fee for any Extension of Time for 
filing of this Brief, and any other fee necessary for filing this Brief on Appeal, or for further 
prosecution, to Deposit Account No. 50-0235. 
I. Real Party In Interest 

Appellant, assignee Green Rees Technologies, LLC, is the real party in interest in this 

matter. 
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II. Related Appeals and Interferences 

There are no related appeals or interferences believed to be related. 

III. Status of Claims 

Claims 1-117 are pending in the application. Claims 2-60, 62, 63, and 66-117 are 
withdrawn from consideration. Claim 1 has been rejected pursuant to 35 U.S.C. 103. Claims 61, 
64, and 65 have been made subject to an objection as being dependent on a rejected base claim, 
but otherwise would be allowable if rewritten in independent form including all limitations of the 
base claim and any intervening claims. Claims 1,61, 64, and 65, are being appealed. 

IV. Status of Amendments Filed Subsequent to Final Rejection 
No amendment has been filed subsequent to the Final Rejection. 

V. Summary of the Claimed Subject Matter 

The claimed subject matter is believed to be summarized well in claim 1 , which is 
as follows: A method of identifying an object, the method including the steps of: directing a 
primary acoustic waveform at the object to produce a nonlinear acoustic effect by using multiple 
projectors driven by a synthetic spectrum; receiving a secondary wavelet produced by the 
nonlinear effect; and processing the received secondary wavelet in identifying the object. 

More particularly, please see the chart below: 
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Claims 

1 . A method of identifying an 
object, the method including the steps of: 

directing a primary acoustic waveform at 
the object to produce a nonlinear acoustic 
effect by using multiple projectors driven by 
a synthetic spectrum; 

receiving a secondary wavelet produced by 
the nonlinear effect; and 



processing the received secondary wavelet 
in identifying the object. 



61 . The method of claim 1 , further 
including the step of shaping the primary 
acoustic waveform into a Gaussian 
envelope that is time differentiated with a 
direct current offset sufficient that none of 
the envelope is negative. 



Representative Support 

... identifying an object by ... Page 24, 
para 1 , line 4. 

The method can include the steps of: 
directing a primary acoustic waveform 
at the object to produce a nonlinear 
acoustic effect - Page 64, paragraph 
2, lines 6-9. See also Fig. 33. 

receiving a secondary wavelet 
produced by the nonlinear effect - 
Page 64, paragraph 2, lines 6-9. See 
also 18 in Figure 30 and Figure 31 . 

processing the received secondary 
wavelet in identifying the object - Page 
64, paragraph 2, lines 6-9. See also 
Figure 31 at boxes 38 
and/or 40, with the main processor 
being 42. 

In any of the embodiments... with a 
direct current offset sufficient that 
none of the envelope is negative... 
6 Page 65, paragraph 1 , lines 3-5. 
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VI. Grounds for Rejection to Be Reviewed on Appeal 
A. §103 

1 . Has the Examiner made a prima facie case that Claim 1 is unpatentable 
pursuant to 35 U.S.C. § 103? 

2. Is the rejection is proper pursuant to 35 U.S.C. § 132? 

VII. Argument 

Because the dependent claims have been found allowable in the Final Rejection, the only 
issues on appeal are directed to independent Claim 1 . It is respectfully submitted that a prima 
facie case of obviousness has not been shown for Claim 1 . The Examiner's rejection does not 
explain how the prior art teaches secondary wavelets. Further, the Examiner has not provided 
evidence in support of the prior art teaching secondary wavelets, as is required pursuant to Rule 
1 .104. The reasons are more particularly set forth below. 

A. The applied references fail to disclose all expressly claimed elements. 

In Appellant's filing of April 26, 2007, at pages 2 to 4, this issue was framed by Appellant 
as follows: 

In the Office Action dated February 27, 2007, the Examiner 
states: "applicant argues that the Sen et al. patent does not disclose or 
show the claimed "secondary wavelet... This is not agreed with. Sen et 
al. discloses "backscattering..." 

Backscattering does not disclose a secondary wavelet, e.g., in 
Sen et al. 

In its plain and ordinary meaning with regard to acoustics, 
"backscattering" refers to: 
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the deflection of radiation or particles by scattering through angles 
greater than 90 (degrees) with reference to the original direction of travel. 

See, for example, the enclosed definition from CHAMBERS: Dictionary of 

Science and Technology (1999); see also McGraw-Hill Dictionary of 

Scientific and Technical Terms (1984) (also enclosed). 

In its plain and ordinary meaning with regard to acoustics, 

"wavelets" refers to: 

mathematical functions that cut up data into different frequency 
components, and then study each component with a resolution matched 
to its scale. They have advantages over traditional Fourier methods in 
analyzing physical situations where the signal contains discontinuities and 
sharp spikes, as well as being compactly constrained in time duration. 

See, for example, the enclosed - which originally appeared in The 

Institute of Electrical and Electronics Engineers) (IEEE) Computational 

Science and Engineering, Summer 1995, vol. 2, num. 2, published by the 

IEEE Computer Society, 10662 Los Vaqueros Circle, Los Alamitos, CA 

90720, USA, TEL +1-714-821-8380, FAX +1-714-821-4010, and can be 

found on the Web as www.amara.com/IEEEwave/IEEEwavelet.html. 

It would seem from the plain and ordinary meaning of the terms 
that the Examiner's contended "backscattering" has no bearing 
whatsoever on the claimed secondary wavelet. .. etc. 

35 U.S.C. Sec. 132 requires that the PTO provide "the reasons for 
such rejection... together with such information as may be useful in 
judging the propriety of continuing prosecution...." There is no mention 
whatsoever of the claimed secondary wavelet in cited art cited in the 
Office Action. Thus, the rejection is premised on the Examiner's 
contention that backscattering in Sen et al. discloses the claimed 
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secondary wavelet . Accordingly, pursuant to 35 U.S.C. Sec. 132, the 
Examiner is required to explain how, pursuant to his rejection, 
backscattering discloses the secondary wavelet . Further, the Examiner's 
declaration or affidavit to establish the contention is required. 

For reference, in the instant application, secondary wavelet 
information is received by means of 18 in Figure 30 and Figure 31 , and 
processed in Figure 31 at boxes 38 and/or 40, with the main processor 
being 42. See also Appellant's specification as it refers to these items. 
The Examiner's 132 explanation and the Examiner's declaration should 
identify the particular components of Sen et al. that are contended as: 

receiving the secondary wavelet produced by the nonlinear 
effect; and processing the received secondary wavelet in identifying the 
object. 

Further, the Examiner's attention is drawn to instant application 
para. 146, wherein the last sentence states: 

If the desire is to produce clean seismic, multi-channel data stacking or to 
employ spectroscopic analysis for discerning material-specific additional 
spectral components (that are induced by nonlinear interaction within or 
inelastic scattering from concealed material), a clean Secondary Wavelet 
energy spectrum is important. 

(Emphasis added.) The Examiner's 132 explanation and the Examiner's 
declaration should explain by what means his contended secondary 
wavelet is produced by the nonlinear effect in Sen et al. 

Appellant maintains that the applied references fail to disclose all 
expressly claimed elements or limitations, and the rejection is improper 
for want of a prima facie showing of unpatentability. 
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Now on appeal, Appellant again submits that the Final Rejection is improper, as is more 
particularly set out below 

1 . Failure to consider filed evidence of unobviousness. 

Appellant's April 26, 2007, filing at page 2, states: "Definitional rebuttal evidence is 
enclosed herewith." The above-mentioned dictionary definitions were provided to the PTO. In 
response, the PTO failed to take note of, comment on, or consider the definitional rebuttal 
evidence or the plain and ordinary meaning of the claim terms, as evidenced thereby. The 
failure to consider this evidence of non-obviousness is clear error. 

2. Misconstruing claim 1. 

Claim terms must be interpreted in the manner understood by those skilled in the art. 
Appellant submits that the artisans would have understood that the meaning of a secondary 
wavelet consistent with the dictionary definitions that Appellant made of record, but which were 
not considered. See Appendix. The dictionary definitions are consistent with usage in the 
specification, as indicated in the above-provided support for the claims. The rejection offers no 
reason why the artisan would have interpreted the claim terminology (and backscattering in Sen 
et al) inconsistent with dictionary and specification meanings. The rejection therefore fails to 
make a proper case of prima facie obviousness. 

3. All claim elements have not been shown in the cited art. 

There is no mention whatsoever of the claimed secondary wavelet in cited art cited in 
the Office Action. More particularly, the cited art does not disclose the claimed receiving the 
secondary wavelet produced by the nonlinear effect; and processing the received secondary 
wavelet in identifying the object. 

As stated above, the Office Action dated February 27, 2007, states: "Appellant argues 
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that the Sen et al. patent does not disclose or show the claimed "secondary wavelet... This is 

not agreed with. Sen et al. discloses "backscattering..." 

But as also stated above, backscattering does not disclose a secondary wavelet, e.g., in 

Sen. As per the above-mentioned definitions, "backscattering" refers to: "the deflection of 

radiation or particles by scattering through angles greater than 90 (degrees) with reference to 

the original direction of travel," and with regard to acoustics, "wavelets" refers to: 

mathematical functions that cut up data into different frequency components, 
and then study each component with a resolution matched to its scale. They 
have advantages over traditional Fourier methods in analyzing physical 
situations where the signal contains discontinuities and sharp spikes, as well as 
being compactly constrained in time duration. 

As further stated above, from the plain and ordinary meaning of the terms, the 
Examiner's contended "backscattering" has no bearing whatsoever on the claimed secondary 
wavelet. .. etc. 

The applied references fail to disclose all expressly claimed elements or limitations, for 
example the secondary wavelets , and thus the rejection fails to make a prima facie case of 
obviousness. In re Fine , 873 F.2d 1071, 5 USPQ2d 1596 (Fed. Cir. 1988). 
4. Summary 

The applied references fail to disclose all expressly claimed elements, i.e., secondary 
wavelets, the Examiner failed to consider the definitional evidence of unobviousness and the 
meaning of the claim terminology in the specification, and misconstrued claim terms outside the 
bounds of what would be considered by an artisan (and failed to provide information required by 
Sec. 132). Thus, the Examiner did not layout a proper case of prima facie obviousness. 

B. Improper reason to combine or modify. 

Though it is respectfully submitted that the foregoing is determinative for reversal of the 
Final Rejection, should the Board conclude otherwise, it is also submitted that the Examiner 
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failed to provide a proper reason to combine or modify, for the reasons set forth below. 

More particularly, in rejecting claims under 35 U.S.C. § 103, it is incumbent upon the 
Examiner to establish a factual basis to support the legal conclusion of obviousness. See In re 
Fine . 837 F.2d 1071, 1073, 5 USPQ2d 1596, 1598 (Fed. Cir. 1988). In so doing, the Examiner 
is expected to make the factual determinations set forth in Graham v. John Deere Co. , 383 U.S. 
1, 17, 148 USPQ 459, 467 (1966), and to provide a reason why one having ordinary skill in the 
pertinent art would have been led to modify the prior art or to combine prior art references to 
arrive at the claimed invention. Such reason must stem from some teaching, suggestion, or 
implication in the prior art as a whole or knowledge generally available to one having ordinary 
skill in the art. Uniroval Inc. v. Rudkin-Wilev Corp. , 837 F.2d 1044, 1051, 5 USPQ2d 1434, 1438 
(Fed. Cir.), cert, denied, 488 U.S. 825 (1988); Ashland Oil. Inc. v. Delta Resins & Refractories, 
Inc. , 776 F.2d 281, 293, 227 USPQ 657, 664 (Fed. Cir. 1985), cert, denied, 475 U.S. 1017 
(1 986); ACS Hospital Systems, Inc. v. Montefiore Hospital , 732 F.2d 1 572, 1 577, 221 USPQ 
929, 933 (Fed. Cir. 1984). These showings by the Examiner are an essential part of complying 
with the burden of presenting a prima facie case of obviousness. Note In re Oetiker , 977 F.2d 
1443, 1445, 24 USPQ2d 1443, 1444 (Fed. Cir. 1992). 

With respect to claim 1 , Appellant's response to the obviousness rejection asserts a 
failure by the Examiner to establish a prima facie case of obviousness since proper motivation 
for the Examiner's proposed combination of references has not been set forth 

1 . Improper reason to combine or modify: inoperability of references. 

Appellant's filing of November 26, 2006, notes that the Examiner's contended 
combination of teachings would render the cited art inoperable for their respective purposes. In 
the Office Action dated February 27, 2007, the Examiner states: "This is also not convincing 
since the mere substitution of one non-linear acoustic source (Rees) for another (Sen et al.) 
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would not render inoperable the system of Sen et al. 

However, Rees is an optical detection system and Sen et al. is not. Sen is an acoustic 
detection system. Rees uses a laser to detect sound generated by weather: as regards 
detection, the acoustic source in Rees is inclement weather (Col. 1 , line 39, etc.). Sen et al. 
uses an acoustic pulse emitter and corresponding acoustic sensors. 

The non-overlapping PTO classes of Rees and Sen et al. evidence that these patents 
involve different technologies, and the Examiner has not explained how one could meld a laser 
to optically detecting weather (Rees) into a system using sound (from an acoustic pulse emitter 
Sen et al.) to detect land mines underground. 

The Examiner has pointed to Col. 15, line 58 - Col. 16, line 4 in Rees: 

using a non-linearly generated and radial range focused acoustic sawtooth wave 
to create an acousto-optic mirror (AOM) acting as a retroreflector. Sufficient 
acoustic enhancement to crate a shock front to a nonlinear acoustic sawtooth 
wave is brought about by transmitting a synthetic spectrum waveform using a 
multiple set of phase locked, pulsed acoustic carrier waveforms each emitted 
from individual projectors in a large array of loudspeakers. Constructive 
interference occurs when these acoustic pulses come together to add 
coherently... the each of these discontinuities act as an optical mirror. 

This section of Rees establishes that Rees is still a system for optical detection of 

inclement weather that can involve "transmitting a synthetic spectrum waveform using a 

multiple set of phase locked, pulsed acoustic carrier waveforms each emitted from individual 

projectors in a large array of loudspeakers" to obtain "constructive interference" that acts "as an 

optical mirror." But "constructive interferences" and an "optical mirror" would not function in the 

ground of Sen. 

The Examiner contends that "the mere substitution of one non-linear source (Rees) for 
another (Sen et al.) would not render inoperable the system of Sen et al. However, an acousto- 
optic mirror (Rees) of course would not function in the granular bed of Sen et al.-e.g., for 
detecting land mines. That is, Rees's optical mirror is to redirect a laser beam, which of course 
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could not possibly function in the ground in Sen et al. 

Attention is respectfully directed to Appellant's filing of April 26, 2007, Para. 2, pages 4- 
6. A rejection premised on an improper reason to combine (contended combination of 
teachings rendered inoperable) is clear error. In re Gordon , 733 F.2d 900, 221 USPQ 1 125 
(Fed. Cir. 1984). 

2. Improper reason to combine or modify: change principles of 
operation. 

In the Office Action dated February 27, 2007, the Examiner states: "such a substitution 
would not change the "principles of operation" of the Sen et al. system. 

But again, optical and acoustic systems have different principles of operation. More 

particularly, Rees teaches, in the Abstract: 

Method and apparatus for detecting conditions in the atmosphere which are 
hazardous to flying aircraft and providing early warning to pilots or ground 
personnel. The method includes using a laser beam and a coherent optical 
receiver to optically sense sound waves produced by those hazardous conditions 
and measuring the effect of those sound waves on the transmitted and received 
optical beams. 

Sen et al. teaches, in Fig. 9, "a detection system according to the present invention" 
(Col. 6, line 26) which shows a platform whereby an acoustic pulse generator 34 points 
downward and "sensor 33 has a tip that contacts the soil." Col. 6, line 36. 

The Examiner's proposed attempt to combine teachings must change the principles of 
operation: As stated above, Rees is premised on the use of a laser and optical detection of the 
sound produced by weather (See Rees, as more precisely set out in Col. 1 , line 39 etc., in view 
of the abstract) while Sen et al. uses a platform whereby an acoustic pulse generator 34 points 
downward so that "sensor 33 has a tip that contacts the soil." (See, e.g., Col. 6, line 36). Thus, 
the transmitters, detectors, and other equipment of the respective patents operate by different 
principles of operation. For example, the beam splitters, an optical line array, telescope, etc. of 
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Rees operate by different principles of operation than, e.g., Fig. 9, of Sen et al. For further 
example, receiving the "acoustic impulse" of Sen et al. in the "telescope" of Rees would not 
function without substantially changing principles of operation. Sen et al.'s detectors are 
unsuitable for optical detection (presumably, under the Examiner's theory, from the ground of 
Sen et al.). 

Part of the reason that the proposed substitution is completely implausible is because 
the respective purposes are not the easiest to harmonize e.g., because one cannot pass a laser 
beam (Rees) underground (Sen et al) for the purpose of detecting "conditions in the 
atmosphere which are hazardous to flying aircraft" (Rees). Nor are weather conditions (Rees) 
to be found in the "granular bed" of Sen et al. Nor do non-metal land mines of Sen et al. fly in 
inclement weather (Rees) or require a ground crew. Nor does an acousto-optic mirror function 
in the granular bed of Sen et al. for detecting land mines. Contradiction between the respective 
references is pervasive, so of course their operating principles are incompatible, the Examiner's 
view that a combination would have been obvious is and completely implausible. 

Attention is respectfully directed to Appellant's filing of April 26, 2007, Para. 3, pages 6- 

8. A rejection premised on an improper reason to combine (change in the principles of 

operation of the devices in the contended combination of teachings) is clear error. In re Clinton , 

527 F.2d 1266, 188 USPQ 365 (CCPA 1976). 

3. No proper motivation or suggestion to combine or modify: 
references teach away. 

In the Office Action dated February 27, 2007, the Examiner states: "the increased 
acoustic enhancement, as suggested by Rees, is motivation. 

The Examiner has omitted that the reason for this feature in Rees is "to create an 
acousto-optic mirror" (Col. 15, line 60). An acousto-optic mirror does not function in the 
granular bed of Sen et al. for detecting land mines. Thus, the Examiner has provided no 
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plausible reason to combine these diverse patents, and indeed the references teach away from 
the proposed combination. 

Attention is respectfully directed to Appellant's filing of April 26, 2007, Para. 4, pages 8- 
9. A rejection premised on no proper reason to combine is clear error, and a rejection premised 
on references that teach away from the combination is clear error. In re Lee , 277 F.3d 1 338, 
1343, 61 USPQ2d 1430, 1433 (Fed. Cir. 2002) and In re Fine , 873 F.2d 1071, 5 USPQ2d 1596 
(Fed. Cir. 1988), respectively. 

4. Summary 

The cited references, combined by the Examiner in attempting to provide teachings of 
the claim as a whole, are directed to fundamentally different technologies: "detecting conditions 
in the atmosphere which are hazardous to flying aircraft and providing early warning to pilots or 
ground personnel... using a laser beam and a coherent optical receiver..." (Rees) and a 
platform whereby an acoustic pulse generator 34 points downward and "sensor 33 has a tip that 
contacts the soil" (Sen et al). These technologies involve fundamentally differences in 
operating principles, such that they are not analogous and respectively teach away from a 
combination of Claim 1 as a whole. The Examiner's proposed combination of the teachings of 
the cited laser and acoustic detection system would still fail to teach the secondary wavelets 
and would also render all of them inoperable for all of their respective purposes. 

The mere fact that the prior art may be modified in some manner suggested by the 
Examiner does not make the modification obvious unless the prior art suggested the desirability 
of the modification. In re Fritch , 972 F. 2d 1260, 1266, 23 USPQ2d 1780, 1783-84 (Fed. Cir. 
1992). Given the disparity of technologies addressed by the applied prior art references, and 
the differing solutions proposed by them (an optic mirror does not work under ground, and 
constructive interference does not identify anything), any attempt to combine them in the 
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manner proposed by the Examiner could only come from Appellant's own disclosure and not 
from any teaching or suggestion in the references themselves. 

C. Failure to provide a response sufficient under 35 U.S.C. Sec. 132. 

Though it is respectfully submitted that the foregoing is determinative for reversal of the 

Final Rejection, should the Board conclude otherwise, it is also submitted that the Examiner 

failed to provide a proper rejection, for the reasons set forth below. 

1. The Examiner's rejection is not understandable within the 

requirements of 35 U.S.C. Sec 132 and not properly evidenced. 

35 U.S.C. Sec. 132 requires that the PTO provide "the reasons for such rejection... 
together with such information as may be useful in judging the propriety of continuing 
prosecution...." The Examiner failed to provide the requested information. 

Attention is respectfully directed to Appellant's filing of April 26, 2007, pages 3, 4, 5, 7, 
and 8. A rejection non-compliant with Sec. 132 is clear error. Evidence, such as the 
Examiner's declaration, was also required - but not provided. 

As stated above, there is no mention whatsoever of the claimed secondary wavelet in 
cited art cited in the Office Action. Appellant requested, and is entitled to "information" as to 
how, pursuant to the Examiner's rejection, backscattering discloses the secondary wavelet as 
claimed and how or by what means the Examiner's contended secondary wavelet is produced 
by the nonlinear effect in Sen et al. Appellant required PTO evidence to support the 
contentions that these elements were disclosed, but there was no Examiner response. 
Because there is no mention whatsoever of the claimed secondary wavelet in cited art in the 
Office Action and no proper means by which to understand the basis for the rejection, and 
further because the dictionary definitional evidence contradicts the Office Action and the Final 
Rejection did not provide the "information" sought pursuant to Sec. 132, the rejection fails to 
make out a proper rejection. 
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D. Summary 

The Final Rejection fails to set out a case of prima facie obviousness. The applied 
references fail to disclose all expressly claimed elements, the PTO failed to consider definitional 
evidence of unobviousness, misconstrued claim terms without justification, and failed to provide 
information required by Sec. 132, the PTO did not make out a proper case of prima facie 
obviousness. 

Even if somehow all claim requirements can be found in the cited art, there has been no 
proper teaching or reasoning as to how or why one of ordinary skill would combine them because 
it would lead to inoperability of references and change the principles of operation references, 
and further the references teach away from a combination to reach Claim 1 as a whole. No 
proper rational or evidence has been provided in which the combination of the prior art could 
result in the Appellant's Claim 1 , since as shown, an acousto-optic mirror does not function in 
the granular bed of Sen et al. to allow for mine detection. Moreover, even if one could contort 
the prior art teachings into a laser/acoustic detection combination of prior art to meet Claim 1 , 
the rejection is still improper for failing to comply with 35 U.S.C. Sec. 132. 

Accordingly, the Examiner has not made out a prima facie case that Claim 1 is 
unpatentable pursuant to 35 U.S.C. Sec.103. 
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Thus, for the reasons more fully set out above, the claims - particularly Claim 1 - 
have not been properly shown as unpatentable, and the rejection was in error. Reversal of the 
Rejection and allowance is respectfully requested. 

Respectfully submitted, 

//■: 

Date: February 1 . 2008 



Peter K. Trzyna 
(Reg. No. 32,601) 



P.O. Box 7131 
Chicago, IL 60680-7131 
(312) 240-0824 
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VIII. Claims Appendix 

1 . A method of identifying an object, the method including the steps of: 
directing a primary acoustic waveform at the object to produce a nonlinear 
acoustic effect by using multiple projectors driven by a synthetic spectrum; 

receiving a secondary wavelet produced by the nonlinear effect; and 
processing the received secondary wavelet in identifying the object. 



64. The method of claim 61 , further including the steps of: 
standardizing the secondary wavelet of the primary wave form by the nonlinear 
acoustic effect that time differentiates the envelope in a projector's far field. 



65. The method of claim 64, wherein the step of processing includes 
discriminating a distortion of the secondary wavelet caused by the object. 
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IX. Evidence Appendix 

The article from www .amara.com titled "An Introduction to Wavelets and a dictionary 
definition backscattering from the Chambers Dictionary of Science and Technology were 
previously submitted on April 26, 2007, and below is a copy of same. 
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An Introduction to Wavelets 



Page 1 of 2 



n introduction to W avelets 




Abstract 



Wavelets are mathematical functions that cut up data into different frequency components, 
and then study each component with a resolution matched to its scale. They have 
advantages over traditional Fourier methods in analyzing physical situations where the 
signal contains discontinuities and sharp spikes.. Wavelets were developed independently in 
the fields of mathematics, quantum physics, electrical engineering, and seismic geology. 
Interchanges between these fields during the last ten years have led to many new wavelet 
applications such as image compression, turbulence, human vision, radar, and earthquake 
prediction. This paper introduces wavelets to the interested technical person outside of the 
digital signal processing field. I describe the history of wavelets beginning with Fourier, 
compare wavelet transforms with Fourier transforms, state properties and other special 
aspects of wavelets, and finish with some interesting applications such as image 
compression, musical tones, and de-noising noisy data. 

Keywords: Wavelets, Signal Processing Algorithms, Orthogonal Basis Functions, Wavelet 
Applications 
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verview 



The fundamental idea behind wavelets is to analyze according to scale. Indeed, some 
researchers in the wavelet field feel that, by using wavelets, one is adopting a whole new 
mindset or perspective in processing data. 

Wavelets are functions that satisfy certain mathematical requirements and are used in 
representing data or other functions. This idea is not new. Approximation using 
superposition of functions has existed since the early 1800's, when Joseph Fourier 
discovered that he could superpose sines and cosines to represent other functions. However, 
in wavelet analysis, the scale that we use to look at data plays a special role. Wavelet 
algorithms process data at different scales or resolutions. If we look at a signal with a large 
"window," we would notice gross features. Similarly, if we look at a signal with a small 
"window," we would notice small features. The result in wavelet analysis is to see both the 
forest and the trees, so to speak. 

This makes wavelets interesting and useful. For many decades, scientists have wanted more 
appropriate functions than the sines and cosines which comprise the bases of Fourier 
analysis, to approximate choppy signals (1). By their definition, these functions are non- 
local (and stretch out to infinity). They therefore do a very poor job in approximating sharp 
spikes. But with wavelet analysis, we can use approximating functions mat are contained 
neatly in finite domains. Wavelets are well-suited for approximating data with sharp 
discontinuities. 

The wavelet analysis procedure is to adopt a wavelet prototype function, called an analyzing 
wavelet or mother wavelet. Temporal analysis is performed with a contracted, high- 
frequency version of the prototype wavelet, while frequency analysis is performed with a 
dilated, low-frequency version of the same wavelet. Because the original signal or function 
can be represented in terms of a wavelet expansion (using coefficients in a linear 
combination of the wavelet functions), data operations can be performed using just the 
corresponding wavelet coefficients. And if you further choose the best wavelets adapted to 
your data, or truncate the coefficients>below a threshold, your data is sparsely represented. 
This sparse coding makes wavelets an excellent tool in the field of data compression. 

Other applied fields that are making use of wavelets include astronomy, acoustics, nuclear 
engineering, sub-band coding, signal and image processing, neurophysiology, music, 
magnetic resonance imaging, speech discrimination, optics, fractals, turbulence, earthquake- 
prediction, radar, human vision, and pure mathematics applications such as solving partial 
differential equations. 
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istorical Perspective 



In the history of mathematics, wavelet analysis shows many different origins (2). Much of 
the work was performed in the 1930s, and, at the time, the separate efforts did not appear to 
be parts of a coherent theory. 

Pre-1930 

Before 1930, the main branch of mathematics leading to wavelets began with Joseph 
Fourier (1807) with his theories of frequency analysis, now often referred to as Fourier 
synthesis. He asserted that any 2 jJ -periodic function f(x) is the sum 

<^+^(a t cosAx+^sm/x) (1) 

of its Fourier series. The coefficients °», a », and b * are calculated by 

+-n\fW*. *-£j/M*»VKy±c, ^=ij/(x)sin(fc)fc 

Fourier's assertion played an essential role in the evolution of the ideas mathematicians had 
about the functions. He opened up the door to a new functional universe. 

After 1807, by exploring the meaning of functions, Fourier series convergence, and 
orthogonal systems, mathematicians gradually were led from their previous notion of 
frequency analysis to the notion of scale analysis. That is, analyzing /ft) by creating 
mathematical structures that vary in scale. How? Construct a function, shift it by some 
amount, and change its scale. Apply that structure in approximating a signal. Now repeat 
the procedure. Take that basic structure, shift it, and scale it again. Apply it to the same 
signal to get a new approximation. And so on. It turns out that this sort of scale analysis is 
less sensitive to noise because it measures the average fluctuations of the signal at different 
scales. 

The first mention of wavelets appeared in an appendix to the thesis of A. Haar (1909). One 
property of the Haar wavelet is that it has compact support, which means that it vanishes 
outside of a finite interval. Unfortunately, Haar wavelets are not continuously differentiable 
which somewhat limits their applications. 

The 1930s 

In the 1930s, several groups working independently researched the representation of 
functions using scale-varying basis functions. Understanding the concepts of basis functions 
and scale-varying basis functions is key to understanding wavelets; the sidebar next 
provides a short detour lesson for those interested. 
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By using a scale-varying basis function called the Haar basis function (more on this later) 
Paul Levy, a 1930s physicist, investigated Brownian motion, a type of random signal (2). 
He found the Haar basis function superior to the Fourier basis functions for studying small 
complicated details in the Brownian motion. 

Another 1930s research effort by Littlewood, Paley, and Stein involved computing the 
energy of a function/ft): 



The computation produced different results if the energy was concentrated around a few 
points or distributed over a larger interval. This result disturbed the scientists because it 
indicated that energy might not be conserved. The researchers discovered a function that 
can vary in scale and can conserve energy when computing the functional energy. Their 
work provided David Marr with an effective algorithm for numerical image processing 
using wavelets in the early 1980s. 

1960-1980 

Between 1960 and 1980, the mathematicians Guido Weiss and Ronald R. Coifman studied 
the simplest elements of a function space, called atoms, with the goal of finding the atoms 
for a common function and finding the "assembly rules" that allow the reconstruction of all 
the elements of the function space using these atoms. In 1980, Grossman and Morlet, a 
physicist and an engineer, broadly defined wavelets in the context of quantum physics. 
These two researchers provided a way of thinking for wavelets based on physical intuition. 

Post-1980 

In 1985, Stephane Mallat gave wavelets an additional jump-start through his work in digital 
signal processing. He discovered some relationships between quadrature mirror filters, 
pyramid algorithms, and orthonormal wavelet bases (more on these later). Inspired in part 
by these results, Y. Meyer constructed the first non-trivial wavelets. Unlike the Haar 
wavelets, the Meyer wavelets are continuously differentiable; however they do not have 
compact support. A couple of years later, Ingrid Daubechies used Mallat's work to construct 
a set of wavelet orthonormal basis functions that are perhaps the most elegant, and have 
become the cornerstone of wavelet applications today. 
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•idebar- What are Basis Functions? 



What are Basis Functions? 

It is simpler to explain a basis function if we move out of the realm of analog (functions) 
and into the realm of digital (vectors) (*). Every two-dimensional vector (x,y) is a 
combination of the vector (1,0) and (0,1). These two vectors are the basis vectors for (x,y). 
Why? Notice that* multiplied by (1,0) is the vector (x,0), and y multiplied by (0,1) is the 
vector (0,y). The sum is (x,y). 

The best basis vectors have the valuable extra property that the vectors are perpendicular, or 
orthogonal to each other. For the basis (1,0) and (0,1), this criteria is satisfied. 

Now let's go back to the analog world, and see how to relate these concepts to basis 
functions. Instead of the vector (x.y), we have a function f(x). Imagine that /fx) is a musical 
tone, say the note A in a particular octave. We can construct A by adding sines and cosines 
using combinations of amplitudes and frequencies. The sines and cosines are the basis 
functions in this example, and the elements of Fourier synthesis. For the sines and cosines 
chosen, we can set the additional requirement that they be orthogonal. How? By choosing 
the appropriate combination of sine and cosine function terms whose inner product add up 
to zero. The particular set of functions that are orthogonal and that construct f(x) are our 
orthogonal basis functions for this problem. 

What are Scale-Varying Basis Functions? 

A basis function varies in scale by chopping up the same function or data space using 
different scale sizes. For example, imagine we have a signal over the domain from 0 to 1 . 
We can divide the signal with two step functions that range from 0 to 1/2 and 1/2 to 1. Then 
we can divide the original signal again using four step functions from 0 to 1/4, 1/4 to 1/2, 
1/2 to 3/4, and 3/4 to 1. And so on. Each set of representations code the original signal with 
a particular resolution or scale. 

Reference 

(*) G. Strang, "Wavelets," American Scientist, Vol. 82, 1992, pp. 250-255. 
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Fourier Analysis 



Fourier's representation of functions as a superposition of sines and cosines has become 
ubiquitous for both the analytic and numerical solution of differential equations and for the 
analysis and treatment of communication signals. Fourier and wavelet analysis have some 
very strong links. 

Fourier Transforms 

The Fourier transform's utility lies in its ability to analyze a signal in the time domain for its 
frequency content. The transform works by first translating a function in the time domain 
into a function in the frequency domain. The signal can then be analyzed for its frequency 
content because the Fourier coefficients of the transformed function represent the 
contribution of each sine and cosine function at each frequency. An inverse Fourier 
transform does just what you'd expect, transform data from the frequency domain into the 
time domain. 

Discrete Fourier Transforms 

The discrete Fourier transform (DFT) estimates the Fourier transform of a function from a 
finite number of its sampled points. The sampled points are supposed to be typical of what 
the signal looks like at all other times. 

The DFT has symmetry properties almost exactly the same as the continuous Fourier 
transform. In addition, the formula for the inverse discrete Fourier transform is easily 
calculated using the one for the discrete Fourier transform because the two formulas are 
almost identical. 

Windowed Fourier Transforms 

If f(t) is a nonperiodic signal, the summatiorrof the periodic functions, sine and cosine, does 
not accurately represent the signal. You could artificially extend the signal to make it 
periodic but it would require additional continuity at the endpoints. The windowed Fourier 
transform (WFT) is one solution to the problem of better representing the nonperiodic 
signal. The WFT can be used to give information about signals simultaneously in the time 
domain and in the frequency domain. 

With the WFT, the input signal f(t) is chopped up into sections, and each section is analyzed 
for its frequency content separately. If the signal has sharp transitions, we window the input 
data so that the sections converge to zero at the endpoints (3). This windowing is 
accomplished via a weight function that places les6 emphasis near the interval's endpoints 
than in the middle. The effect of the window is to localize the signal in time. 



3\ 
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Fast Fourier Transforms 

To approximate a function by samples, and to approximate the Fourier integral by the 
discrete Fourier transform, requires applying a matrix whose order is the number sample 
points n. Since multiplying an n xn matrix by a vector costs on the order of »' arithmetic 
operations, the problem gets quickly worse as the number of sample points increases. 
However, if the samples are uniformly spaced, then the Fourier matrix can be factored into 
a product of just a few sparse matrices, and the resulting factors can be applied to a vector 
in a total of order ftlD « n arithmetic operations. This is the so-called fast Fourier transform or 
FFT (4). 
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Wavelet vs Fourier Transforms 



Similarities between Fourier and Wavelet Transforms 

The fast Fourier transform (FFT) and the discrete wavelet transform (DWT) are both linear 
operations that generate a data structure that contains segments of various lengths, 
usually filling and transforming it into a different data vector of length 2*. 

The mathematical properties of the matrices involved in the transforms are similar as well. 
The inverse transform matrix for both the FFT and the DWT is the transpose of the original. 
As a result, both transforms can be viewed as a rotation in function space to a different 
domain. For the FFT, this new domain contains basis functions that are sines and cosines. 
For the wavelet transform, this new domain contains more complicated basis functions 
called wavelets, mother wavelets, or analyzing wavelets. 

Both transforms have another similarity. The basis functions are localized in frequency, 
making mathematical tools such as power spectra (how much power is contained in a 
frequency interval) and scalegrams (to be defined later) useful at picking out frequencies 
and calculating power distributions. 

Dissimilarities between Fourier and Wavelet Transforms 

The most interesting dissimilarity between these two kinds of transforms is that individual 
wavelet functions are localized in space. Fourier sine and cosine functions are not. This 
localization feature, along with wavelets' localization of frequency, makes many functions 
and operators using wavelets "sparse" when transformed into the wavelet domain. This 
sparseness, in turn, results in a number of useful applications such as data compression, 
detecting features in images, and removing noise from time series. 

One way to see the time- frequency resolution differences between the Fourier transform and 
the wavelet transform is to look at the basis function coverage of the time-frequency plane 
(5). Figure 1 shows a windowed Fourier transform, where the window is simply a square 
wave. The square wave window truncates the sine or cosine function to fit a window of a 
particular width. Because a single window is used for all frequencies in the WFT, the 
resolution of the analysis is the same at all locations in the time- frequency plane. 
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Frequency 




Time 



Fig. 1. Fourier basis functions, time-frequency tiles, and coverage of the time- 
frequency plane. 

An advantage of wavelet transforms is that the windows vary. In order to isolate signal 
discontinuities, one would like to have some very short basis functions. At the same time, in 
order to obtain detailed frequency analysis, one would like to have some very long basis 
functions. A way to achieve this is to have short high-frequency basis functions and long 
low-frequency ones. This happy medium is exactly what you get with wavelet transforms. 
Figure 2 shows the coverage in the time- frequency plane with one wavelet function, the 
Daubechies wavelet. 



Frequency 




Time 



Fig. 2. Daubechies wavelet basis functions, time-frequency tiles, and coverage of the 
time-frequency plane. 

One thing to remember is that wavelet transforms do not have a single set of basis functions 
like the Fourier transform, which utilizes just the sine and cosine functions. Instead, wavelet 
transforms have an infinite set of possible basis functions. Thus wavelet analysis provides 
immediate access to information that dan be'obscured by other time- frequency methods 
such as Fourier analysis. 
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What do Some Wavelets Look Like? 



Wavelet transforms comprise an infinite set. The different wavelet families make different 
trade-offs between how compactly the basis functions are localized in space and how 
smooth they are. 

Some of the wavelet bases have fractal structure. The Daubechies wavelet family is one 
example (see Figure 3). 




Fig. 3. The fractal self-similiarity of the Daubechies mother wavelet. This figure was 
generated using the WaveLab command: wave=MakeWavelet ( 2 , -4 , ' Daubechies ' , 4 
' Mother ' , 2048). The inset figure was created by zooming into the region x=\ 200 to 
1500. 



Within each family of wavelets (such as the Daubechies family) are wavelet subclasses 
distinguished by the number of coefficients and by the level of iteration. Wavelets are 
classified within a family most often by the number of vanishing moments. This is an extra 
set of mathematical relationships for the coefficients that must be satisfied, and is directly 
related to the number of coefficients (1). For example, within the Coiflet wavelet family are 
Coiflets with two vanishing moments, and Coiflets with three vanishing moments. In Figure 
4, 1 illustrate several different wavelet families. 




Fig. 4. Several different families of wavelets. The number next to the wavelet name 
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represents the number of vanishing moments (A stringent mathematical definition related to 
the number of wavelet coefficients) for the subclass of wavelet. Note: These figures were 
created using Wav eLab, by typing: 

wave = MakeWavelet(2,-4, ' Daubechies ' , 6, 'Mother', 2048); 
wave = MakeWavelet (2, -4, 'Coiflet',3, 'Mother', 2048); 
wave •= MakeWavelet (0, 0, 'Haar', 4, 'Mother' , 512); 
wave = MakeWavelet (2, -4, ' Symmlet * , 6, 'Mother', 204 8); 



[H ome] [ Wavelet Pag e] [Contents] [Previous] [Next] 



• Click HERE to download a gripped, Postscript copy (compressed to 222 Kbytes, expands to 
l.SMbytes). 

• Or click HERE to download a PDF version (360 Kbytes) 



Last Modified by Amara Graps on 12 May 2004. 
© Copyright Amara Graps, 1995-2004. 



2* 




avelet Analysis 



Now we begin our tour of wavelet theory, when we analyze our signal in time for its 
frequency content. Unlika Fourier analysis, in which we analyze signals using sines and 
cosines, now we use wavelet functions. 

The Discrete Wavelet Transform 

Dilations and translations of the "Mother function," or "analyzing wavelet" define an 
orthogonal basis, our wavelet basis: 



The variables s and / are integers that scale and dilate the mother function to generate 
wavelets, such as a Daubechies wavelet family. The scale index 5 indicates the wavelet's 
width, and the location index / gives its position. Notice that the mother functions are 
rescaled, or "dilated" by powers of two, and translated by integers. What makes wavelet 
bases especially interesting is the self-similarity caused by the scales and dilations. Once we 
know about the mother functions, we know everything about the basis. 

To span our data domain at different resolutions, the analyzing wavelet is used in a scaling 
equation: 



where W(x) is the scaling function for the mother function *M , and c * are the wavelet 
coefficients. The wavelet coefficients must satisfy linear and quadratic constraints of the 
form 



where s is the delta function and / is the location index. 

One of the most useful features of wavelets is the ease with which a scientist can choose the 
defining coefficients for a given wavelet system to be adapted for a given problem. In 
Daubechies' original paper (6), she developed specific families of wavelet systems that were 
very good for representing polynomial behavior. The Haar wavelet is even simpler, and it is 
often used for educational purposes. 

It is helpful to think of the coefficients {«. «.} a s a filter. The filter or coefficients are 

placed in a transformation matrix, which is applied to a raw data vector. The coefficients are 



* w (x)=2**(2-'x-/) (3) 
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ordered using two dominant patterns, one that works as a smoothing filter (like a moving 
average), and one pattern that works to bring out the data's "detail" information. These two 
orderings of the coefficients are called a quadrature mirror filter pair in signal processing 
parlance. A more detailed description of the transformation matrix can be found elsewhere 
(4). 



To complete our discussion of the DWT, let's look at how the wavelet coefficient matrix is 
applied to the data vector. The matrix is applied in a hierarchical algorithm, sometimes 
called a pyramidal algorithm. The wavelet coefficients are arranged so that odd rows 
contain an ordering of wavelet coefficients that act as the smoothing filter, and the even 
rows contain an ordering of wavelet coefficient with different signs that act to bring out the 
data's detail. The matrix is first applied to the original, full-length vector. Then the vector is 
smoothed and decimated by half and the matrix is applied again. Then the smoothed, halved 
vector is smoothed, and halved again, and the matrix applied once more. This process 
continues until a trivial number of "smooth-smooth-smooth..." data remain. That is, each 
matrix application brings out a higher resolution of the data while at the same time 
smoothing the remaining data. The output of the DWT consists of the remaining "smooth 
(etc.)" components, and all of the accumulated "detail" components. 



The Fast Wavelet Transform 



The DWT matrix is not sparse in general, so we face the same complexity issues that we 
had previously faced for the discrete Fourier transform (7). We solve it as we did for the 
FFT, by factoring the DWT into a product of a few sparse matrices using self-similarity 
properties. The result is an algorithm that requires only order n operations to transform an «- 
sample vector. This is the "fast" DWT of Mallat and Daubechies. 



Wavelet Packets 

The wavelet transform is actually a subset of a far more versatile transform, the wavelet 
packet transform (8). 



Wavelet packets are particular linear combinations of wavelets (7). They form bases which 
retain many of the orthogonality, smoothness, and localization properties of their parent 
wavelets. The coefficients in the linear combinations are computed by a recursive algorithm 
making each newly computed wavelet packet coefficient sequence the root of its own 
analysis tree. 

Adapted Waveforms 

Because we have a choice among an infinite set of basis functions, we may wish to find the 
best basis function for a given representation of a signal (7). A basis of adapted waveform is 
the best basis function for a given signal representation. The chosen basis carries substantial 
information about the signal, and if the basis description is efficient (that is, very few terms 
in the expansion are needed to represent the signal), then that signal information has been 
compressed. 

According to Wickerhauser (7), some desirable properties for adapted wavelet bases are 
1 . speedy computation of inner products with the other basis functions; 

m 
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2. speedy superposition of the basis functions; 

3. good spatial localization, so researchers can identify the position of a signal that is 
contributing a large component; 

4. good frequency localization, so researchers can identify signal oscillations; and 

5. independence, so that not too many basis elements match the same portion of the 
signal. 

For adapted waveform analysis, researchers seek a basis in which the coefficients, when 
rearranged in decreasing order, decrease as rapidly as possible, to measure rates of decrease, 
they use tools from classical harmonic analysis including calculation of information cost 
functions. This is defined as the expense of storing the chosen representation. Examples of 
such functions include the number above a threshold, concentration, entropy, logarithm of 
energy, Gauss-Markov calculations, and the theoretical dimension of a sequence. 
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omputer and Human Vision 



In the early 1980s, David Marr began work at MIT's Artificial Intelligence Laboratory on 
artificial vision for robots. He is an expert on the human visual system and his goal was to 
learn why the first attempts to construct a robot capable of understanding its surroundings 
were unsuccessful (2)- 

Marr believed that it was important to establish scientific foundations for vision, and that 
while doing so, one must limit the scope of investigation by excluding everything that 
depends on training, culture, and so on, and focus on the mechanical or involuntary aspects 
of vision. This low-level vision is the part that enables us to recreate the three-dimensional 
organization of the physical world around us from the excitations that stimulate the retina. 
Marr asked the questions: 

• How is it possible to define the contours of objects from the variations of their light 
intensity? 

• How is it possible to sense depth? 

• How is movement sensed? 

He then developed working algorithmic solutions to answer each of these questions. 

Marr's theory was that image processing in the human visual system has a complicated 
hierarchical structure that involves several layers of processing. At each processing level, 
the retinal system provides a visual representation that scales progressively in a geometrical 
manner. His arguments hinged on the detection of intensity changes. He theorized that 
intensity changes occur at different scales in an image, so that their optimal detection 
requires the use of operators of different sizes. He also theorized that sudden intensity 
changes produce a peak or trough in the first derivative of the image. These two hypotheses 
require that a vision filter have two characteristics: it should be a differential operator, and it 
should be capable of being tuned to act at any desired scale. Marr's operator was a wavelet 
that today is referred to as a "Marr wavelet." 
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FbI Fingerprint Compression 



Between 1 924 and today, the US Federal Bureau of Investigation has collected about 30 
million sets of fingerprints (7). The archive consists mainly of inked impressions on paper 
cards. Facsimile scans of the impressions are distributed among law enforcement agencies, 
but the digitization quality is often low. Because a number of jurisdictions are 
experimenting with digital storage of the prints, incompatibilities between data formats have 
recently become a problem. This problem led to a demand in the criminal justice 
community for a digitization and a compression 'Standard. 

In 1993, the FBI's Criminal Justice Information Services Division developed standards for 
fingerprint digitization and compression in cooperation with the National Institute of 
Standards and Technology, Los Alamos National Laboratory, commercial vendors, and 
criminal justice communities (9). 

Let's put the data storage problem in perspective. Fingerprint images are digitized at a 
resolution of 500 pixels per inch with 256 levels of gray-scale information per pixel. A 
single fingerprint is about 700,000 pixels and needs about 0.6 Mbytes to store. A pair of 
hands, then, requires about 6 Mbytes of storage. So digitizing the FBI's current archive 
would result in about 200 terabytes of data. (Notice that at today's prices of about $900 per 
Gbyte for hard-disk storage, the cost of storing these uncompressed images would be about 
a 200 million dollars.) Obviously, data compression is important to bring these numbers 
down. 




Fig. 5. An FBI-digitized left thumb fingerprint. The image on the left is the original; the 
one on the right is reconstructed from a 26: 1 compression. These images can be retrieved by 
anonymous FTP. (Courtesy Chris Brislawn, Los Alamos National Laboratory. 



[Home] [Wa velet Pag e] [Contents! [Previous] [Next] 



http://www.amara.com/lEEEwave/IW_fbi.html 



AI25I2ML 



impression Page 2 of 2 

ifmn^ t0 d0Wn, ° ad * 8ZlPPed ' P ° StSCript C ° Py < com P ressed *> 222 Kbytes, expands to 
• Or click HERE to download a PDF version (360 Kbytes) 



Last Modified by AmaraGrm on 12 May 2004. 
© Copyright Amara Graps, 1995-2004. 



43 

http.7/www. aniara.com/IEEEwave/IW fbi.html 



4/25/2007 



'enoising Noisy Data 



In diverse fields from planetary science to molecular spectroscopy, scientists are faced with 
the problem of recovering a true signal from incomplete, indirect or noisy data. Can 
wavelets help solve this problem? The answer is certainly "yes," through a technique called 
wavelet shrinkage and thresholding methods, that David Donoho has worked on for several 
years (10) . 

The technique works in the following way. When you decompose a data set using wavelets, 
you use filters that act as averaging filters and others that produce details (11) . Some of the 
resulting wavelet coefficients correspond to details in the data set. If the details are small, 
they might be omitted without substantially affecting the main features of the data set. The 
idea of thresholding, then, is to set to zero all coefficients that are less than a particular 
threshold. These coefficients are used in an inverse wavelet transformation to reconstruct 
the data set. Figure 6 is a pair of "before" and "after" illustrations of a nuclear magnetic 
resonance (NMR) signal. The signal is transformed, thresholded and inverse-transformed. 
The technique is a significant step forward in handling noisy data because the denoising is 
carried out without smoothing out the sharp structures. The result is cleaned-up signal that 
still shows important details. 



Fig. 6. "Before" and "after" illustrations of a nuclear magnetic resonance signal. The 

original signal is at the top, the denoised signal at the bottom. (Images courtesy David 
Donoho, Stanford University, NMR data courtesy Adrian Maudsley, VA Medical Center, 
San Francisco). 

Figure 7 displays an image created by Donoho of Ingrid Daubechies (an active researcher in 
wavelet analysis and the inventor of smooth orthonormal wavelets of compact support), and 
then several close-up images of her eye: an original, an image with noise added, and finally 
denoised image. To denoise the image, Donoho: 
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1 . transformed the image to the wavelet domain using Coiflets with three vanishing 
moments, 

2. applied a threshold at two standard deviations, and 

3. inverse-transformed the image to the signal domain. 




Fig. 7. Denoising an image of Ingrid Daubechies' left eye. The top left image is the 
original. At top right is a close-up image of her left eye. At bottom left is a close-up image 
with noise added. At bottom right is a close-up image, denoised. The photograph of 
Daubechies was taken at the 1993 AMS winter meetings with a Canon XapShot video still- 
frame camera. (Courtesy David Donoho) 
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Detecting Self-similarity in a Time Series 



Wavelet analysis is proving to be a very powerful tool for characterizing behavior, 
especially self-similar behavior, over a wide range of time scales. 

In 1993, Scargle and colleagues at NASA- Ames Research Center and elsewhere 
investigated the quasiperiodic oscillations (QPOs) and very low-frequency noise (VLFN) 
from an astronomical X-ray accretion source, Sco X-l as possibly being caused by the same 
physical phenomenon (12). Sco X-l is part of a close binary star system in which one 
member is a late main sequence star and the other member (Sco X-l) is a compact star 
generating bright X rays. The causes for QPOs in X-ray sources have been actively 
investigated in the past, but other aperiodic phenomena such as VLFNs have not been 
similarly linked in the models. Their Sco X-l data set was an interesting 5-20 keV 
EXOS AT satellite time-series consisting of a wide-range of time scales, from 2 ms to 
almost 10 hours. 

Galactic X-ray sources are often caused by the accretion of gas from one star to another in a 
binary star system. The accreted object is usually a compact star such as a white dwarf, 
neutron star, or black hole. Gas from the less massive star flows to the other star via an 
accretion disk (that is, a disk of matter around the compact star flowing inward) around the 
compact star. The variable luminosities are caused by irregularities in the gas flow. The 
details of the gas flow are not well-known. 

The researchers noticed that the luminosity of Sco X-l varied in a self-similar manner, that 
is, the statistical character of the luminosities examined at different time resolutions 
remained the same. Since one of the great strengths of wavelets is that they can process 
information effectively at different scales, Scargle used a wavelet tool called a scalegram to 
investigate the time-series. 

Scargle defines a scalegram of a time series as the average of the squares of the wavelet 
coefficients at a given scale. Plotted as a function of scale, it depicts much of the same 
information as does the Fourier power" spectrum plotted as a function of frequency. 
Implementing the scalegram involves summing the product of the data with a wavelet 
function, while implementing the Fourier power spectrum involves summing the data with a 
sine or cosine function. The formulation of the scalegram makes it a more convenient tool 
than the Fourier transform because certain relationships between the different time scales 
become easier to see and correct, such as seeing and correcting for photon noise. 

The scalegram for the time-series clearly showed the QPOs and the VLFNs, and the 
investigators were able to calculate a power-law to the frequencies. Subsequent simulations 
suggested that the cause of Sco-Xl's luminosity fluctuations may be due to a chaotic 
accretion flow. 
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Victor Wickerhauser has suggested that wavelet packets could be useful in sound synthesis 
(13). His idea is that a single wavelet packet generator could replace a large number of 
oscillators. Through experimentation, a musician could determine combinations of wave 
packets that produce especially interesting sounds. 

Wickerhauser feels that sound synthesis is a natural use of wavelets. Say one wishes to 
approximate the sound of a musical instrument. A sample of the notes produced by the 
instrument could be decomposed into its wavelet packet coefficients. Reproducing the note 
would then require reloading those coefficients into a wavelet packet generator and playing 
back the result. Transient characteristics such as attack and decay- roughly, the intensity 
variations of how the sound starts and ends- could be controlled separately (for example, 
with envelope generators), or by using longer wave packets and encoding those properties 
as well into each note. Any of these processes could be controlled in real time, for example, 
by a keyboard. 

Notice that the musical instrument could just as well be a human voice, and the notes words 
or phonemes. 

A wavelet-packet-based music synthesizer could store many complex sounds efficiently 
because 

• wavelet packet coefficients, like wavelet coefficients, are mostly very small for 
digital samples of smooth signals; and 

• discarding coefficients below a predetermined cutoff introduces only small errors 
when we are compressing the data for smooth signals. 

Similarly, a wave packet-based speech synthesizer could be used to reconstruct highly 
compressed speech signals. Figure 8 illustrates a wavelet musical tone or tomburst. 



Fig. 8. Wavelets for music: a graphical representation of a Wickerhauser toneburst. 

This screenshot of a toneburst was taken while it was playing in the Macintosh commercial 
sound program Kaboom! Factory. (Toneburst courtesy Victor Wickerhauser) 

Press UAl to hear this wavelet toneburst (1 10 kB). 
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Most of basic wavelet theory has been done. The mathematics have been worked out in 
excruciating detail and wavelet theory is now in the refinement stage. The refinement stage 
involves generalizations and extensions of wavelets, such as extending wavelet packet 
techniques. 

The future of wavelets lies in the as-yet uncharted territory of applications. Wavelet 
techniques have not been thoroughly worked out in applications such as practical data 
analysis, where for example discretely sampled time-series data might need to be analyzed. 
Such applications offer exciting avenues for exploration. 
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Some Wavelet Resources 

The amount of wavelets-related material is multiplying. Many papers and software sources 
are on Internet. 



Press 



for my current list of Wavelet Resources. 
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